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There is often a finite way to represent an infinite 
sequence collectively. In particular, a 
closed formula 


is especially convenient. A 
recursion rule 


specifies later values in the sequence from earlier values. 
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1.1 SEQUENCES AS LISTS 


In this section, we consider some common kinds of 
sequences and some of their attributes. 


DEF: A sequence in a set S is a list of elements of that 
set S (called the range of the seq) 


To Fi @2 


indexed by the non-negative integers, or sometimes by 
some other countable set. 


NOTATION: Some of the most standard sets of numbers 
that serve as ranges for sequences are denoted here in 
blackboard bold typeface style: 


Le =F ieee. 2 ly O Ts. ie} cibesers 
Zt = {1, 2, 3, ...} positive integers 
N= {0, 1, 2, ...} natural numbers 

IR = real numbers 

Q = rational numbers 

C = complex numbers 
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DEF: An algebraic expression in the argument n for the 
value of the general element z,, of a sequence (z,,) is called 
a closed formula for the (elements of the) sequence. 


Example 1.1.1: The closed formula 
Ci. = n> —5n 
specifies the sequence 


(tn) : 0 —-4 -2 12 44 100 186 


Example 1.1.2: The closed formula 


Yn = gnt2 — n°? 


specifies the sequence 


(yn) 1 4 7 8 5 0 3 40 
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Fast-Growing Sequences 


Rate of growth is understood in relation to the stan- 
dard indexing sequence, 1.e., the natural numbers. 


Example 1.1.3: polynomial seq (x, = n”) 
n Oo Ube, 2-23 4 5 
n?7} 0 1 4 9 16 25 ---. 


A polynomial sequence of degree greater than 1 grows 
more rapidly than the natural numbers. 


Example 1.1.4: exponential seq (x, = 3”) 


n OU: el 2 3 4 #5 
oa” | Tf -3 9 2% 61 243° 2+ 


Once a precise notion of comparative rate of growth is 
in hand in 81.4, it will be provable that any exponential 
sequence (x, = 6”) with b > 1 “grows more rapidly” than 
any polynomial sequence. Of course, if 0 < 6 < 1, then 
the sequence (a, = 6”) decreases. For instance, 


n OE Oe es ee 
nm 1 1 1 1 1 
Q/3)"| 1 3 6 ow 8 om 


Example 1.1.5: A seq that grows even more rapidly 
than an exponential sequence is the factorial sequence 


n/|/ 0 Ll 2 3 4 5 
mi} 1 1 2 6 24 120 --- 
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Slow-Growing Sequences 


Various other increasing seqs grow slowly, relative to 
the integers. ‘The first example here involves a fractional 
exponent. The second and third involve logarithms and 
harmonic numbers. 


Example 1.1.6: A sequence (x, = nm") grows more 
slowly than Zt if0<r< 1. Eg., 


n 0 1 2 3 4 5 oes 
pO. de a2. 9/3 Dh By ys 
Example 1.1.7: ‘The sequence 


n i 2 3 on 
len| O 1 Ig3 2 Ig5 --- 


grows even more slowly than the seq (x, =n"), for r > 0. 
(See Exercises. ) 


DEF: The harmonic number 4H,, is defined as the sum 


rr 


1 


Se + 
= 7 


Slr 


1 
Z 
k=1 


with Ho = 0 for the empty sum. 


Example 1.1.8: ‘The harmonic sequence 
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is closely related to the natural logarithm Inn, as ex- 
plained in 83.1. 


Example 1.1.9: The values in a sequence need not be 
numbers. 


PREVIEW OF 88.7: The surface S, is the surface with g 
handles in the following sequence. 


SICICCIOCor 
So Sy So S3 


Bounded Sequences 


DEF: A bounded sequence (z,,) is a sequence (typically 
of real numbers or integers) for which there is a number B 
(called a bound), such that 


eel < B for all n 
The sequence is bounded in absolute value. 


Example 1.1.10: ‘The real sequence 


1 
ei oe TV 
( at) 


is bounded. It is always non-negative, and its value never 
exceeds 1. 
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Periodic Sequences 
DEF: A periodic sequence (z,,) is a sequence for which 
there is a positive integer P, such that 
Ljit+Pp = Xj for all 7 E N 
The smallest such integer is called the period of the 
sequence. 
Example 1.1.11: An alternating sequence of 0’s and 1’s 
0 1010 1 
is periodic with period 2. 
DEF: The remainder function on a pair of integers n € N 
and d € Z* is defined as 
n 
dd = n—-d|=| 
n mo n 5 


It is also called the mod function. The arguments n and 
d are called the dividend and the divisor, respectively. 


Example 1.1.12: The sequence n mod 3 


n O: i 2 8 we 
nmmod3{ 0 1 2 0 1 2 
is periodic with period 3. More generally, for any fixed 
divisor m, the sequence 
(fn = nmod m) 


is periodic with period m. 
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Generalizations 


Example 1.1.13: The formula x(n) = 3” can also be 
regarded as a specification of the extended sequence 
3" 4re Z): 





DEF: An array of dimension d in a set S is a function 
from the set of d-tuples of natural numbers to the set S. 


NOTATION: Array elements are commonly written in the 
subscripted notation 


L0,.0 0,1 0,2 
11.0 1,1 1,2 
L2.0 2,1 2,2 


DEF: The integer interval {k : m] is the set 
{k, k+1, ..., m} 


The integer interval [1 : n] is used as the standard set of 
cardinality n. 
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Eventual Behavior of Sequences 


DEF: A sequence (z,) eventually has property P if 
there is a number N such that the subsequence (z,, | n > 
N) has property P. 


Example 1.1.14: ‘The sequence 
(t, = n* —8n+15) 


is eventually increasing, as illustrated in Figure 1.1.1. Its 
shape is an upward parabola, with its minimum at n = 4, 
after which it is strictly increasing. Thus, it is eventually 
increasing. 


100 


80 
60 
40 
20 


0 
012345 6 7 8 9 1011 12 13 14 


Fig 1.1.1 An eventually increasing sequence. 


Example 1.1.15: The sequence (x, = 2n°® — 2”) is 
eventually decreasing. 
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Remark: Every polynomial (except a constant) is even- 
tually increasing or eventually decreasing, depending on 
the sign of its term of highest degree. 


Example 1.1.16: The decimal digits of 


4824 


——~ = 0.92412121212... 
8250 


are eventually periodic, as illustrated in Figure 1.1.2. 


NO e%) > 
a 
Sd 


0123 45 6 7 8 9 1011 1213 14 


Fig 1.1.2 An eventually periodic sequence. 
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1.2 RECURRENCES 


Most of the sequences considered in $1.1 were speci- 
fied by a closed function j ++ xj. 


DEF: A standard recurrence for a sequence prescribes 
a set of initial values 


Lo — 6 “1, = by ae re = oy 
and a recursion formula 
De, SO Wiig Wye es By) LOR Sk 


from which one may calculate the value of x,, for any 
n > k, from the values of earlier entries. 


Example 1.2.1: ‘The recurrence 


oo 0 initial value 
In = Ln-1 t+2n—1_ recursion 


has as its first few values 
rp = 0 4 Srl Ly =A ts = 9 C4 == 16 
We observe that the recursion formula here depends only 


on a fixed number of predecessors of x,,, specifically, only 
on Ln_1- 


DEF: Inferring a closed formula from a recurrence is called 
solving the recurrence. 


Section 1.2 Recurrences 13 


Example 1.2.1, cont.: ‘The first few values specified by 


the closed formula z,, = n? are 


OF 0) Aelza. DPe Be 0). acl 6 
These coincide with those specified by the given recurrence 
rp = 0 4 A t5-= 4 13 = 39 a-— 16 


An induction can prove that x,, = n? solves the recurrence. 


Method of Small Cases 


Sometimes it is possible to guess the solution to a 
recurrence. More generally, the following approach goes a 
long way in mathematics. 


1. Examine some small cases systematically. 
2. Guess a pattern that covers all those cases. 
3. Prove that the guess is correct. 
We now describe recurrences and closed formulas for 


three well-known sequences: the Tower of Hanoi sequence, 
the Fibonacci sequence, and the Catalan sequence. 
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Tower of Hanoi 





Fig 1.2.1 ‘Tower of Hanoi puzzle. 


(1) Only one disk may be transfered at a time. 


(2) No disk may ever lie on top of a smaller disk. 


The minimum number h,, of moves needed to transfer n 
disks satisfies the following recurrence: 


RECURRENCE 
ho = 0 initial value 
hie = Dien peel recursion 


We use the recursion to calculate the first few values of 
h,, and then guess a closed formula. 


SMALL CASES 


ho = 0 

a APPARENT PATTERN 
ho = 3 a — 
h; = 7 

iy = LS 


Having guessed that h, = 2” — 1, we proceed to confirm 
the guess with a proof. 
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Thm 1.2.1. The Tower of Hanoi recurrence 


ho = 0; An = 2hyn-1+1 forn>1 (1.2.1) 


has the solution 


hyn =2"-1 (1.2.2) 


Proof: By induction. 


BASIS: Applying the formula (1.2.2) yields the equation 
ho = 2? —1 =1-—1=0, which agrees with the prescribed 
initial condition hp = 0. 


IND HYP: Assume that h,—, = 2”7!-1. 


IND STEP: Starting with the recursion (1.2.1), we now 
complete the proof. 


hy, = 2hn-1 +1 given recursion 
= 2(2"1-1)+1 induction hypothesis 
| 


— 9r_q % 
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Fibonacci Sequence 


DEF: The Fibonacci sequence (f,,) is defined by the 
recurrence 


fo.s= Oy Fp = al initial values 


fn = fr-1 t+ fr-2 forn 22 ee) 


Here are the first few entries: 


nm] O12 3 4 5 6 47 8 Qs: 
jn | O. 1 12 3 5 8 13 21 34 + 


DEF: A Fibonacci number is any number that occurs in 
the Fibonacci sequence. 


A closed formula for the Fibonacci recurrence is not 
easily guessed from the small cases. (But, once guessed, 
the solution is verifiable by a routine inductive proof.) See 
82.5. 


f= = (s" — 6") (1.2.4) 


1 x 
+ v5 and @ = 








where @ = 


i) 
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Example 1.2.2: For the time being, it is interesting 
to confirm an instance of the correctness of the formula 
(1.2.4) for the Fibo number f,,. 


“i io ur) 


ee 


8 8 
— 1 (143875415455 1 (1-3V5+15 -— 5v5 
= 
_ 1 /6v¥5+10V5)\ _ , 
SG. 5 = 


a 


Catalan Sequence 


DEF: The Catalan sequence (c,,) is defined by the re- 
currence 


Sk 


Ch = CoCn—1 + C1iCn—2 + +++ + Cn—1C9 


Here are the first few entries: 


nm| O12 3 4 5 6 #7 
Cc, | L 1 2 5 14 42 1382 429 .--- 


DEF: Any number that occurs in the Catalan sequence is 
called a Catalan number. 
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Derivation of this closed formula appears in 84.4. 


2 ee ) (1.2.6) 





Example 1.2.3: cz, = 


Proving Properties of Sequences 


Proof that a sequence has some given property can be 
derived either from a closed formula or from a recursion, 
with the aid of mathematical induction. As an illustration, 
we consider the properties of concavity and convezity. 


DEF: A sequence (z,,) is concave (on the integer interval 


[a : bj) if 


Ln-1 ae Unt+1 


Ln 2 5 


(forn =a+l1,..., 6-1) 


This means that the point (n,z,,) lies above the line seg- 
ment joining the points (n —1,z¢,_1) and (n+1,2,41) in 
the plane, as in Figure 1.2.2. 
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Xn4+1 
Xn 


Xn-1 


n-l n n+l 


Fig 1.2.2 Concavity in a sequence. 


Example 1.2.4: Concavity of the sequence 





1 
lt, = 1-7) 
follows from the observation that 
9 9 2 9 21 9 2n 
OU) Ngee os ne ee 





1 1 
SS Les = n— n 
( —z)+( <=) ee 


Example 1.2.5: That the Fibonacci sequence (fp) is 
eventually increasing, after n = 2, follows easily by math- 
ematical induction. Moreover, it is a consequence for all 
n> $3that fr < 2fn_1. 


DEF: A sequence (z,,) is convex (on the integer interval 
[a : bj) if 


Ln-1 +2 
tn < n—-Ll n+1 


forn =a+t+l,..., b-1 
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This means that the point (n,z,,) lies below the line seg- 
ment joining the points (n —1,z¢,_1) and (n+1,2@,41) in 
the plane, as in Figure 1.2.3. 


Xn4+1 


Xn 
Xn-1 


n-l n n+l 


Fig 1.2.3 Convexity in a sequence. 


Example 1.2.6: ‘The Fibo seq is eventually convex, af- 
ter n = 2. This is now confirmed: 


re iis SS ae (by the Fibo recursion) 
SDT. (by Example 1.2.5) 


which is equivalent to the defining condition for convexity. 
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1.3 PASCAL’S RECURRENCE 


DEF: The combination coefficient (;') is the number of 
ways (sometimes called combinations) to choose a subset 
of cardinality k from a set of n objects. 





Fig 1.3.1 There are (5) ways to choose 3 balls 


from the 9 in the urn. 


Prop 1.3.1. The combination coefficients a) satisfy 


Pascal’s recurrence 


(I, ) (3) =< I for alln > 0 


k 


(= Ge CG) oes 


Proof: The initial values are easily confirmed. Our first 
proof for the recursion formula (R) is algebraic. The sec- 
ond is combinatorial. 


(Iz) a = 0 forallk>1 
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Algebraic Proof: Algebraic proof of (R) starts with 
the right side of the equation and makes substitutions and 
arithmetic operations that result in the left side. 


(a1) +(e") = Geieamn * ek 


_ k(n-1)! (n—k)(n—1)! 
— ki(n—k)! ki(n—k)! 


[A+(n—k)|(n —1)! 
ki(n—k)! 


“apo = (i) ¢ 


Combinatorial Proof: The left side counts the num- 
ber of ways to choose a subset of size k from the integer 
interval [1 : n]. If such a subset includes object n, then it 
is counted by the summand Gay on the right side. Al- 
ternatively, if such a subset excludes object n, then all k 
objects must be chosen from [1 : n—1], and it is counted by 
the summand Gay This approach is called the Method 
of Distinguished Element. 


Binomial Coefficients 


DEF: The coefficient 6, of a® in the expansion 


(l+a)" = So bn. ak 
k=0 


is called a binomial coefficient. 
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Example 1.3.1: Binomial coefficients can be calculated 
by iteratively multiplying by 1+ <2. 

1 

l+a) =1lt+¢e 

l+e) =14+2¢+2° 

l+a)? = 14 3¢ + 327+ 2° 

L+a)* = 14 4@ + 6a? + 42° + 2? 


o— 
ee 
+ 
8 
— 
© 
| 


Proposition 1.3.2. The binomial coefficients by, satisfy 
Pascal’s recurrence. 


Proof: The initial values of Pascal’s recurrence are sat- 
isfied, since the values 


bn.60.= 1 for all n > 0 
bon = 0 for all k > 1 


can be verified by considering the direct expansions of 
(1+2)° and (14+ 2)", as in Example 1.3.1. To show that 
the recursion is satisfied, it is observed that 


nm n—1 
Shwe” Sola) bane oa) 
k=0 k=0 
n—1 n—1 
= ieee + a>. Cn ae 
k=0 k=0 


n—1 n—1 
k k+1 
= S bn—1,4 © ste S bn—1,4 © - 
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Tr Tr 
k k 
= y Ope st y On—1,k—-1 © 
Tr 


Ss” (bpae pepe” (82) 
k=0 


Thus, the coefficient b,,, of x” in the sum at the left of 
equation (1.3.1) must equal the coefficient of x” in the sum 
at the right in equation (1.3.2), i-e., it must equal the sum 


Onete. One 4. & 


Cor 1.3.3. For all n,k > 0, the number es of ways to 
choose k objects from a set of n distinct objects equals the 
binomial coefficient bry. 


Proof: By Prop 1.3.2, the combination coefficients G) 
and the binomial coefficients b,,;, satisfy the exact same re- 
currence system. An induction argument establishes that 
the values must be the same. » 


mr 


TERMINOLOGY NOTE: ‘The number ( ) is commonly called 
a binomial coefficient. From here on in this book, we 
shall refer to it as such. 
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DEF: If the zero values are left blank, then the array of 


binomial coefficients has a triangular shape and is called 
Pascal’s triangle. 


Table 1.3.1 Pascal’s A for values of ( 


ES 
oo! 
— 
os 
3 
— 
oo~ 
Ww 3 
— 
os 
ws 
— 
ao 
mS 
es 
os 
ous 
— 
aa 
Os 
— 


1 
1 
1 
1 
1 
1 
1 





In this form of Pascal’s triangle, each number is the sum 
of the number directly above it and the number in the row 
above, one column to the left. Pascal’s triangle also has a 
pyramid form: 


1 
1 1 
Ty. 2 ol 
1 3 3 1 
1 4 6 4 1 
1 5 10 10 5 1 
1 6 15 20 15 6 1 
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1.4 DIFFERENCES AND SUMS 


DEF: Given a sequence (a,,), we define the difference se- 
quence (Aa,,) by the rule 
Aan = Gn4+1 — On 


More generally, given a function f : R — R, we define the 
difference function Af by the rule 


Af (2) = fle +1) — f(z) 


Example 1.4.1: Ifa, =n?, then 
Aa, = (nt+1)*—n? = 2n+1 
and 
Aa, = (2(n+1)+1)—(2n+1) = 2 
These equations yield this difference table. 
d,=n* |0 1 4 9 16 25 36 49 


Adn i 8 OA ae 
Aa, 22 DO. Oe OD 


Example 1.4.2: The sequence (b, = n°) has the dif- 
ference table, which was created by calculating its initial 
row and then iteratively taking differences. 


b, =n? | 0 1 8 27 64 125 216 343 
Ab, i 9. 9. BT! GL. OL 197 
Ab, 6 42: 48. 9e 30 386. we 
AB, 6 6 6 6 6 + 
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Properties of the Difference Function 


In Examples 1.4.1 and 1.4.2, we observe that the sec- 
ond and third rows of the difference tables for the se- 
quences (n*) and (n°), respectively, have the constant val- 
ues 2 = 2! and 6 = 3!. An initial aspect of our exploration 
is to establish that this phenomenon holds generally. 


Proposition 1.4.1. The difference operator A is linear. 
That is, 


A(f(n) + eg(n)) = (AF)(n) + e(Ag)(n) 
Proof: The details are straightforward. 


A(f(n) + eg(n)) = (f(r +1) + cg(n +1)) — (f(r) + eg(n)) 
(f(n +1) — f(n)) + e(g(n + 1) — g(n)) 
= (Af)(n) + e(Ag)(n) % 


Prop 1.4.2. In the difference table for the seq 

(n" |n EN) 
the r** row has the constant value r!, and, accordingly, 
all subsequent rows are null. 


Proof: By induction. 


BASIS: The entries in the 0" row of the sequence (n°) 
all have the value 1 = O!. 
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IND HYP: Assume that all the entries in the (r —1)** row 
of the table for n’~+ have the value (r — 1)! and that all 
higher order rows are null. 


IND STEP: It follows from the expansion 
A(n") = (n41)" — nn” = rn” + bon"? + +--+ do 


(for appropriate coefficients 6;) and from the linearity of 


A. that 


DNR) = AOA )) 


= AVY (pyr si bai ieee bo) 
r—2 
r AO) (nt) + S26; AVY (né) 


j=0 


By the induction hypothesis, A'"—!)(n/) = 0, for 7 < r—2, 
from which it follows that every term in the sum on the 
right has value 0. Thus, 


A (n") = pH (n’—1) 


It follows that the r‘® row of the difference table for (n”) 
equals r times the (r — 1)* row of the table for n”—?, in 
which every entry has the value (r — 1)!, by the induction 
hypothesis. o; 
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Summation Operator 


DEF: Let (z,,) be a sequence with values in an algebraic 
structure with an addition. Then the expression 


nr 
ee 
7=0 


is called the n** partial sum. 


DEF: The summation operator maps a sequence 
(fn | n €N) to the sequence of partial sums 


(ds nen 


Example 1.4.3: Under the summation operator, the in- 
teger sequence 


nS A. SB. 8 
is mapped to the integer sequence of its n™ partial sums 
(5 = Se+1)) 
j=0 
which begins with the values 


1 4 9 16 
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It may be guessed that u, = (n+ 1)*, which is readily 
proved by induction. If one now defines 


n—1 
am = > (27 +1) 
j=0 
then the sequence (a, = n7) has the values 


O 1 4 9 16 


which inverts Example 1.4.1. We recall from 80.3 that the 
empty sum is defined to be zero. ‘This accounts for the 
value 


n—1 = 
a = D/Qi+1) = DIQi+1) = 0 
j=0 j=0 


The next theorem establishes that the inversion is not 
at all a coincidence. 


NOTATION: From time to time, it is convenient to use the 
notation x; as an alternative to Az;. 


Thm 1.4.3(a). Let (x, |n€N) be aseq. Then 


n—1 
ye, = peg (1.4.1) 
j=0 
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Proof: Another straightforward calculation. 


= 
| 
ke 
= 
| 
ke 


> 2} = (2541 — %3) 


=e — £0) + (@2— 21) + +++ + (fp — Fp-1) 
(pn —Lp—1) + (@n-1 — En—2) + °° + (£1 — Zo) 


= In — Xo » 


. 


The upper limit of the sum in equation (1.4.1) must be 
n—1, rather than n, to get the correct result. Figure 
1.4.1 illustrates the proof of Theorem 1.4.3(a). The sum 


3 

/ 

a ) Lj 
j=0 


of the lengths along the y-axis clearly equals the height x4 
of the rightmost rectangle. ‘Thus, 


3 
— I 
L4—-—%Q = ) vy 
j=0 


which is the total vertical distance from the top of the 
leftmost rectangle to the top of the rightmost rectangle. 
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(x1 — £0) + (to — 21) + (3 — Bo) + (%4—23) = 24 — XO 





Fig 1.4.1 Accumulating consecutive differences, as 
in Theorem 1.4.3(a). 


Theorem 1.4.3(b). Let (x, | n € N) be a sequence. 
Then 


/ 
k-1 

) Ly = In 
j=0 " 


Proof: By the def of the difference operator, 


/ 
k-1 (n+1)-1 n—1 
) x 5 — ) a5 = ) x 5 
j=0 " j=0 j=0 
— In 6 


Fig 1.4.2 illustrates the proof of Thm 1.4.3(b). 
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(eo ta, +%2+%43+2%4) — (ota, +%2+%43) = 2X4 





Fig 1.4.22 Subtracting consecutive sums, as in 
Theorem 1.4.3(b). 


The difference of the sum xp) +---+ 24 of the areas of 
the consecutive rectangle including 74 and the sum xo + 
--- + a3 of the areas excluding x4 clearly equals the area 
x4 of the rightmost rectangle. 


TERMINOLOGY: Thm 1.4.3 is a form of what is commonly 
called the Fundamental Theorem of Finite Calculus. 
One sees a direct analogy to the Fundamental ‘Theorem of 
Infinitessimal Calculus: 


(a) [ sf 4=F@)-F0 


o £f rOd=F@) 
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Growth Rate of Sequences 


The most common criterion for comparing the long 
term behavior of two sequences is called asymptotic domi- 
nance. However, by way of analogy to differential calculus, 
a possible measure of the growth rate of a seq is its differ- 
ence seq. 


Example 1.4.4: ‘To establish, in the sense of finite dif- 
ferences, that the sequence (n*) grows faster than the se- 
quence (cn*), for any constant value of c, we make the 
following calculations. 
An? (ntl)? —n® = 3n?+3n+1 
Aen? = e(n+1)?—en® = 2en+e 


For n > c, we have 
3n7 +3n > 3en+3c¢ > 2en+t+e 
Thus, An? eventually dominates Acn?. 


Another possible measure of the growth rate of a sequence 
of positive values is the sequence of ratios 


In 


of consecutive terms. 

Example 1.4.4, cont.: The successive ratios of n° are 
n+1)° n° + 3n?4+3n+1 3 3 1 
one }  —— ee a eo 


n? 





n> n> 


and the successive ratios of cn? are 
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e(n+1)? — cn*+2en+e 


en? en? 


which are clearly smaller. 


2 it 
be Sia 
Ww 


35 
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1.5 FALLING POWERS 


REVIEW FROM 80.2: The n‘ falling power of a real 
number x is the product 


n factors 
_————————— TN 
ct = a(a—1)--- («-—n+1) forn EN 


We recall that the differential calculus has nice for- 
mulas: 
d d 
a a? = 2a a ge? = 327 etc. 
So does the calculus of finite differences, but these are not 
examples of them: 
A(a*) = 2¢41 
A(e#*) = 32° + 3¢41 
In the calculus of finite differences, the falling monomial 
x“ lends itself quite naturally to nice formulas that are 
analogous to those of the ordinary monomial zx”. 


Example 1.5.1: <A “nice formula”. 
A(a2) = («+1)2 — ae 
(c+1)xe(a-—1) — x(a —-—1)(x -2) 
= [(@+1) — (e—-2)]e(@—-1) 


= 32(2—-1) = 3a4 


Now generalize Example 1.5.1. 
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Theorem 1.5.1. A(x") = ret, 





Proof: A straightforward approach. 

A(t) = («+1)-- 2° 

(a+ 1)et — gh (2 —r +1) 

(2) esr) = reat > 


Corollary 1.5.2. For every non-negative integer r and 
every positive integer n, 


nrth 


ma ~ <a 








rel 
Proof: We have j= = A (= | by Theorem 1.5.1. 
r 


Thus, by the Fundamental Theorem of Finite Calculus, it 
follows that 











n—1 go 1 nit 
Sit = = o 
= Fabel eG r+1l 


Example 1.5.2: Direct addition and the formula of Cor 
1.5.2 give the same result when summing k?2. 


Sok = 0-(-1) + 1-042-143-244-3 = 20 


52 9:°4°-3 
= = = 20 
3 3 
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Unimodal Sequences 


DEF: A sequence (z,,) is unimodal if there is an index M@ 
such that 


Li Si, eS Vay. Sy 


and that (,,) is non-increasing after index WM. The value 
zy is called the mode and M the mode index. (A tie 
is permitted at the mode value.) 


Example 1.5.3: Most of the unimodal seqs of interest 
in the present context are eventually 0. Figure 1.5.1 illus- 
trates that the sequence (7) is unimodal. 


80 
60 
40 


20 


01234567 8 
Fig 1.5.1 The unimodal sequence (2)s 
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Thm 1.5.3. For any fixed non-negative integer n, the 
binomial sequence 


CC) p= Osa) 


is unimodal with mode index |n/2| and is eventually 0. 





Proof: We observe that for r < S|. we have — as 
i 


1 
and, hence, Bae Pies 


ie 
— 1 
Thus, oe > 1. Accordingly, 
r 


(01) = Gem 


== w= Py] 
(r—1)! r 


ne n 
rl Np 


Moreover, for r > S| , we have n < 2r+1, and it follows 





<< 





that n-—r<r-+1. Thus, i <1. It follows that 
i, 
n _ ntl Se. Z nm =) 
rti/  (rti)! orl r+l ~ rt \e 
Of course, the sequence is zero for r > n. : 


Remark: Unimodality of a sequence may make it possible 
to find the maximum by hill-climbing, for which there exist 
highly efficient computational strategies. 
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Log-Concavity and Log-Convexity 


In trying to establish unimodality, curiously enough, 
it is often easier to prove the stronger property called log- 
concavity. 


DEF: A sequence (a,,) of positive real numbers is log- 
concave (on the integer interval [a : 6]) if, for n = a+ 
Toeea de Oak 


log 1 + log tn41 


logr, > (1.5.1) 
and is log-convex if 
log tn-1 +logz, 
logt, < log Sn—1 108 Fn+1 (1.5.2) 


2 


Prop 1.5.4. A sequence (x,,) of positive real numbers is 
log-concave (on the integer interval {a : b|) if and only if, 
forn=a-+l1,...,0, 

, ae ee ee (1.5.3) 


mr 


It is log-convex if and only if 


GS aes (1.5.4) 


Proof: The defining condition (1.5.1) for log-concavity 


log %p—1 + log tn41 


loga, > 
Og & = 9 
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is equivalent to the inequality 

2logz, > logry,—, + log an441 (1.5.5) 
Exponentiating both sides of inequality (1.5.5) leads to 
inequality (1.5.3), Le., 


2 
Ly 2 Una et 


A similar argument establishes the equivalence of inequal- 
ities (1.5.2) and (1.5.4). & 


Thm 1.5.5. Let (a,,) be a log-concave sequence (over the 
integer interval |a: b]). Then it is unimodal (over that 
integer interval). 


Proof: It follows from Proposition 1.5.4 that the se- 
quence of ratios 


Ly TQ 2&3 
LQ Fy 2 


(wherever defined) is non-increasing. That is, 


x x 

2 n n+1 

Ln a LIn-1Tn41 => oe 
Ln—-1 Ln 


V 





Let M be the largest number k in the integer interval [a : 5] 


such that 
Lk 





> 1 
Uk-1 
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or M = aif no such number k exists. Then the initial 
subsequence 


La Vat eee LM 
is increasing and the terminal subsequence 
UM M41 «+--+ Lb 


is non-increasing, precisely the conditions for 
unimodality with mode index M. o; 


Theorem 1.5.6. The binomial sequence 


(() [eo 


is log-concave on the integer interval [0 : n]. 





Proof: The falling-power formula for binomial coeffs is 


2 pine? 
a Gs 
() = Gi) 
z < 1 and oan < 1, it follows that 
1 n—rt+l 


ne Z s ne ne r n—-r 
ri rl rl r+til n-r-dil 


and, in turn, that 
n\? q n= ne r n—T 
r ri! rf r+l n-—-r+l 


~ eae a ~ ea 





Since 
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Accordingly, by Proposition 1.5.4, the binomial sequence 
is log-concave. .o; 


Remark: Theorems 1.5.6 and 1.5.5 can be used together 


to reconfirm Theorem 1.5.3, that the sequence of binomial 


coefficients (), for k = 0,...,n, is unimodal. 
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1.6 STIRLING NUMBERS: PREVIEW 


Stirling numbers are highly useful in counting parti- 
tions and permutations. 


Falling into Ordinary Powers 


The following theorem provides a recursive method 
for converting a falling power into ordinary powers. 


Theorem 1.6.1. Any falling power x“ can be expressed 
as a linear combination of ordinary powers, i.e., in the 
form 


Tr 
a ) Sk a® with Snn =1 and sn9 =0forn>1 
k=0 


Proof: By induction on the exponent n. 


BASIS: For n = 0 and n = 1, we have 
2 = 12° 
gt = 1x'+4+02° 
Thus, we take soo = 1, $1.1. = 1, and $1.9 = 0. 
IND HYP: Suppose for some n > 1 that there exist integer 


coefficients 


Sm—1,0 Sn—1,1 +++ Sn—1,n—1 
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for which 
n—Ll 
grat — Sn—1,k ak with Sn—-1.n—-1 = 1 and Sn—-1,0 = 0 
k=0 


IND STEP: It follows that 


gt = g@t.(¢—n4+1) (def of falling power x”) 
n—1 
= (x-n+1) > Santee (ind hyp) 
r=0 
n—1 n—1 
= Seas hs (n —1) oasis ak 
n—1 
= —(n—1)8n—102° + SY (Sn—1b-1 — (% — 1)8n—1,4) 
k=1 
5 Sta 
n—1 
= 02° + > (8n-1,4-1 — (2 — 1) Sn—18) 2 Lae 
k=1 
Thus, we may take 8,9 = 0, Snn = 1, and spy, = 


Sn—1,.k—-1 — (n = Leetaites for0O<k <n. > 
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DEF: The coefficients s,,, in the summation 


mr 


a ) See” 


k=0 


are called Stirling numbers of the first kind. For 
k>nork <0, the Stirling number s,,;, is taken to be 0, 
corresponding to letting the upper and lower limits of the 
sum go to ©. 


The Stirling numbers s,,,, can be calculated by multiplying 
the factors in the expansion 


ct = a(4—1)(4—2)--- («@—n+1) 


ge = g* — g! 
ge = g?° — 32° + Qe! 
gt = g* ~ 62? + lle? — 62! 


eg = x — 10x2* + 352° — 50r7? + 2421 


Thus, $5.2 = —50 and s3,; = 2. We observe the alternating 
signs in each equation. 
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Ordinary into Falling Powers 


Expressing an ordinary power as a sum of falling pow- 
ers is an analogous task. 


Thm 1.6.2. Any ordinary power x” can be expressed as 
a linear combination of falling powers, i.e., in the form 


LoS ys c® with Sia lL and Sno —O0ior ws 1 
k=0 


Proof: Once again, we use induction on the exponent n. 
BASIS: For n=0 and n= 1, we have 

e = 122 

a+ = 1e++0a% 
We take So,9 = 1, 51,1 = 1, and $1.9 = 0. 


IND HYP: Suppose that for some n > 1, the monomial 
z”—1 can be expressed as a linear combination 


J 
gt = ) Si, ae 
k=0 


of falling-power monomials S;,;, z®, each of degree less than 
or equal to 7. 
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IND STEP: ‘Then 


— es n—-Ll 


38 
ms 


xe Said vk (inductive hypothesis) 
k=0 


n—1 
= >. ai ae ot 
k=0 
n—1 


n—1 
= Sn—1k (e@—k)-e® + De Syaie kee 
k=0 k=0 


n—1 n—1 
k+1 k 
= S ae (ae al S Rona vc 


n n—1 
= S fe kS Ee 
= n=1;k=1 20> oF n—1,k © 


n—-Ll 


=) Sata Gait +k Spi.) 2% + 0Sp-1,9 2% 
k=1 


Thus, we may take 
Sno = 0, Sain = 1, and Sn,k = 8n—-1,k-1 + RSn—1,k 


forO<k<n. c 
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DEF: The coefficients 5, in the sum 


Tr 
a ) Sinn ve 
k=0 


are called Stirling numbers of the second kind. For 
k>nork < 0, the Stirling number 5, is 0, which 
corresponds to letting the upper and lower limits of the 
sum go to ©. 


Example 1.6.2: 


a = g24 4 


ae = ¢2 4+ 3724 ct 
a = we 4+ 6224 7x2 + at 
2 = 22+ 100% + 252% + 15224 at 


Thus, 55,3 = 25 and 54,2 =a 


Corollary 1.5.2 provides a simple formula for the sum 
of the values of any falling power n“, over an interval of 
integer values of the base n. Accordingly, due to the linear- 
ity of the difference operator (Proposition 1.4.1), we could 
calculate the sum of the values of any ordinary power n”, 
over a range of values of n, if we first express n” as a linear 
combination of falling powers. 
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Example 1.6.3: Notice, in particular, in Example 1.6.2, 
that n? = n2+ nz. It follows from Theorem 1.6.2 that 


mr mr mr 
Lf SD ee 
j=0 j=0 j=0 


(n+ 1)3 (n+ 1)2 


3 72 
B.g., O0+14+4+9+164+25+36 = ats = 70421 = 91. 

In turn, this enables us to calculate the sum of the 
sequential values of a polynomial, since a polynomial is 
a linear combination of ordinary powers. ‘This method 
of summing the values of polynomials will be further ex- 
plored in §3.4. 


Partitions 


DEF: A partition of a set S is a family F = {5},...,5n} 
of mutually disjoint subsets of S, called the cells of the 
partition F, whose union is S. 


NOTATION: Cells of partitions of a set may be indicated 
by the use of hyphens. If the set is small enough, then its 
elements can be represented by single characters, thereby 
avoiding potential ambiguities latent in juxtapositions of 
the characters. 
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Example 1.6.4: The partition { {1,3}, {2,5}, {4} } of 
the integer interval [1 : 5] may be denoted 


13 —25—4 


or also, for instance, by 4-52-13, since the cells of a 
partition and the order within cells are taken to be un- 
ordered. 


Stirling Subset Numbers 
DEF: The Stirling subset number 
n 
tas 
is the number of ways to partition the integer interval 
[1 : n] into k non-empty non-distinct cells.” 


In 85.1, we establish that the Stirling number S,,,;, of 


the second kind equals the Stirling subset number eee 
Example 1.6.2, cont.: The value S42 = 7 is consistent 
with the following list of 7 partitions of [1 : 4] into 2 cells, 
as an ad hoc calculation of Pak 


L293. Das Bas, A= 193 
(D394... Tes a8 


* Wikipedia acknowledges D. E. Knuth for promoting usage of 
the user-friendly notations, { ne and Bak of the Serbian mathemati- 
cian J. Karamata (1902-1967) for Stirling numbers. 
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Stirling Cycle Number 


DEF: The Stirling cycle number |/'| is the number of 
ways to partition the integer interval [1 : n] into k non- 
empty non-distinct cycles. 


In 85.2, we establish that the Stirling number s,,, of 
the first kind equals the absolute value of the Stirling cycle 
number al 


Example 1.6.1, cont.: The value s4.2 = 11 of the Stir- 
ling number of the first kind is consistent with the fol- 
lowing list of 11 partitions of the integer interval [1 : 4| 
into 2 cycles, as an ad hoc calculation of the Stirling cycle 


number ia i 


(1)(2 3 4), (2)(1 3 4), (3) 

(1)(2 4 3), (2)(1 4 3), (3) 
(4)(1 2 3), (4)(1 3 2) 

(1 2)(3 4), (1 3)(2 4), (1 4)(2 3) 


Remark: Since the Stirling cycle numbers 
lal Nol. @ 
1 2 n 
correspond to an inventory of all permutations of the in- 


teger interval [1 : n], according to the number of cycles in 
their disjoint cycle representation, it follows that 


|") = = 


jai b 
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1.7 ORDINARY GENERATING FNS 


A sequence (g,,) can be represented by the polynomial 


OO 
oe = gtnz+gex7 +: 
n=0 


DEF: An (ordinary) generating function (abbr. OGF) 
for the sequence (g,,) is any closed form G(z) such that 


Ge) = Sega” 
n=0 


or, sometimes, it means the polynomial itself. 


Exponential Generating Functions 


Another kind of generating function, called an expo- 
nential generating function, is also used directly for count- 
ing and in solving recurrences. More extensive develop- 
ment of exponential generating functions appears in §5.5. 


DEF: An exponential generating function 
(abbr. EGF) for a sequence (g,,) is any closed form G'(z) 
corresponding to the infinite polynomial 


CO yn 
Dd In 
n=0 : 


or, sometimes, the polynomial itself. 
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Direct Counting with OGFs 


Ordinary generating functions are readily applicable 
to counting unordered selections. We return to a counting 
problem first raised in Example 0.3.13. 


Example 1.7.1: A combination of letters from the word 
SYZYGY may contain at most one 8. Thus, an ordinary 
generating function for the number of possible combina- 
tions containing no letters that are not 9’s is 


1l+s 


Similarly, ordinary generating functions for combinations 
containing no letters except Z’s and no letters except G’s 
are, respectively 


l1+z and l+g 
Since the word SYZYGY contains three Y’s, the OGF for 


counting combinations containing no letters except Y’s is 
Eis seer 


which signifies that there is one choice with no Y’s, one 
choice with one Y, one with two Y’s, and one with three 
Y’s. In the product 


(l1+s)1+z)\1l+g9)ltyt+ty ty’) 


of these four generating functions, the terms of degree d 
provide an itemization of the ways to select d letters from 
SYZYGY. For instance, the seven terms of degree 2 are 


sz sg sy zg zy gy yr 
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It follows that if each of the indeterminates s, z, g, and y 
is replaced by a single indeterminate, say z, 


(lta)?(l+e2+27+2°%) 
then the coefficient of x@ in the expansion 
1+ 4a + 7a? + 82° + 7x* + 4e° + 2° 


is the number of ways to select d letters from SYZYGY. 
The general principle is articulated by the following propo- 
sition. 


Prop 1.7.1. Let G(z) and H(z) be the OGFs for count- 
ing unordered selections from two disjoint multisets S and 
T. Then G(z)H(z) is the OGF for counting unordered se- 


lections from the union S UT’. 


Proof: This is a direct application of the Rule of Sum 
and Rule of Product. » 


Direct Counting with EGFs 


Exponential generating functions are readily applica- 
ble to counting ordered selections. We continue the anal- 
ysis of Example 1.7.1. 


Example 1.7.1, cont.: An ordered selection of letters 
from SYZYGY may contain at most one $. Thus, an ex- 
ponential generating function for the number of possible 
combinations containing no letters that are not $’s is 


1l+s 


56 Chapter 1 Sequences 


Similarly, exponential generating functions for ordered se- 
lections containing no letters except Z’s and no letters ex- 
cept G’s are, respectively 


l+z and l+g 


Since the word SYZYGY contains three Y’s, the expo- 
nential generating function for counting ordered selections 
containing no letters except Y’s is 
2 3 
Y Y 

Le oer oI a 31 
which signifies that there is one way with no Y’s, one way 
with one Y, one with two Y’s, and one with three Y’s. In 
the product 


D 3 
(1+ s)(1+ z)(1+4q) +4444) 
of these four generating functions, the terms of degree d 
provide an itemization of the ways to select d letters from 
SYZYGY. Suppose that the multivariate indeterminate 
monomial of a term of degree d is given the denominator 
of d!. For instance, this would give the transformation 


zgy" st A! gy” = | gy” 
2! 2!1fi! =! old 4! 








in which the multinomial coefficient (5 a 4) is the number 


of ways to order the selection ZGYY represented by the 


Section 1.7 Ordinary Generating Fns 5/ 


monomial zgy*. It follows that if each of the indetermi- 
nates s, z, g, and y is replaced by a single indeterminate, 
say 2, 


2 xe 
(l+2)° (40+ 54 =] 


then the coefficient of x@ in the expansion 


PS 3 a4 2? 
4 ee a sb ipods 190 4 129% 


1! 2) 3! A! 5] 6! 
is the # of ordered selections of d letters from SYZYGY. 


The general principle is as follows. 


Prop 1.7.2. Let G(z) and H(z) be the EGFs for counting 
ordered selections from two disjoint multisets S and T’. 
Then G(z)H(z) is the EGF for counting ordered selections 
from the union SUT. 


Proof: ‘This is a another direct application of the Rule 
of Sum and Rule of Product. » 


Analyzing a Generating Function 


To use generating functions effectively, either for di- 
rect counting or for solving recurrences, one needs to be 
able to analyze generating functions so as to recover a 
closed-form function for the list of entries. We now indi- 
cate briefly how this might be done, deferring most of the 
details to Chapter 2. 
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Example 1.7.2: When a closed-form generating func- 
tion is a quotient of polynomials, such as 


a 


i=o5 52 et) 


one way to extract the entries of the sequence is by long 
division of polynomials. 


yA 87? ae Ty a be? eae 


132-23" yz 
R237 Oe 
822-2 27° 
327 — 92° + 624 
7z> — 624 


This yields the coefficients of smaller powers z”, but not a 
closed form. Factoring the denominator of the expression 
(1.7.1) and splitting the fraction into two parts, like this 


Zz 1 1 
(l—z)(1-2z) 1-2z 1-2 
= (1422427774 282% +...) 
— (L+z4+274+2°4---) 


CO 


» Oral 


n=O 


is the standard way to recover a closed-form. See §2.3. 
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Remark: Example 1.7.2 uses the familiar algebraic iden- 
tity 
i 


= ta eycia yf Paes 
1—ay 





which can be justified either by long division or by multi- 
plying 1 — ay andl +ay+a?y?+--+. 


Rational Functions 


DEF: A quotient of two polynomials in z (each with finitely 
many terms) is called a rational function in z. If the 
degree of the numerator is less than the degree of the de- 
nominator, then it is called a proper rational function. 


Long division of the denominator into the numerator 
transforms a generating function G'(z) represented as a 
rational function 


bp + by z+---+6,2° 
Giz) = 2S 
Ch Cie ere 


into its power series 


G(z) = go + giz + goz7 ++: 


as in Example 1.7.2. Moreover, it will be shown in Chapter 
2 how to use factoring of the denominator, as in Example 
1.7.2, to represent the values of the sequence by a closed 
function. For the time being, we consider another case of 
this phenomenon. 
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Example 1.7.3: Here is an additional illustration of the 
effect of factoring the denominator and splitting the frac- 
tion into a sum of fractions with linear polynomials as 
denominators 

z—1 —2 1 


G SO —_-S—<C—Ci 
(2) feo Tee ee 


—2(14 3243727 4---) + (142242727 4+---) 








CO 


S| (2” —2-3")2" 


n=O 


Taylor Series 


The fact that a rational function can be reconverted 
into a power series motivates the use of the terminology 
generating function, because a rational function may be 
regarded as generating its coefficients by the process of 
long division. Another sense in which a function G(z) can 
generate the coefficients of a power series is by application 
of a Taylor series expansion at z = 0. 


se 
a 


2 


mr 
+ G’" (0) 31 


Gz) = G(0) + 4’(0) 5 +6" (0) Aon 


that assigns to the infinitely differentiable function G(z) 
the power series 


G(z) = go + mz + goz? +: 
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where 
Gir) (0) 


ni 





In = 


Using Taylor series permits an interpretation of a wide 
range of infinitely differentiable functions as generating 
functions. 


Example 1.7.4: For the function G(z) = —In(1 — z), 
the value of the n*# derivative at z = 0 is 


—1)! 
Gl) (0) = ee =(n-1)! forn>1 
LZ) z=0 
and, thus, 
Z oP Z° “1, 
GES ORO! Gl a eae ee ae 


That is, the function —In(1 — z) is the OGF for the se- 


quence (tp, = =). 


Addition and Scalar Multiplication 


There is a correspondence between various operations 
on sequences (a,,) and (b,,) and some operations on their 
associated generating functions 


A(z) = ae and B(z) = Yeo 
720 


j=0 
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DEF: The sum of two sequences (a,,) and (b,,) is the 
sequence 


ag +bo, a1 +61, ag + bo, 


This corresponds to the sum of their generating functions, 
i.e., to the generating function 


(A+ B)(z) = So (aj +0;)z 
7=0 


DEF: Multiplying the sequence {a,,} by the scalar c 
yields the sequence 


Cag, Cal, Ca2, 


This corresponds to the generating function 


cA(z) = Sa? 
j=0 
that results from multiplying the generating function A(z) 
by that scalar. 
Example 1.7.5: Since the ordinary generating functions 
i 1 
ee ee ae 
generate the sequences (a, = 5”) and (b, = 7"), respec- 
tively, it follows that the ordinary generating function 
2 3 5 — 29z 

2A 3B = ——_-_— =o 

EG Gee? page eT) 
generates the sequence (2-5"+3.-7"). 
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Products and Convolutions 


The following two examples illustrate how one might 
use products of OGF's in direct computations. 


Example 1.7.6: Consider counting the number p,, of 
ways to make n¢ postage from 3¢ and 5¢ stamps. If one 
had nothing but 3¢ stamps, the OGF would be 


ae = 1 get go get ae ase 

1— <2 
since there is exactly one way from 3¢ stamps alone to 
make each multiple of 3, and no way to make any other 
postage. Similarly, if one had nothing but 5¢ stamps, the 
OGF would be 


S> bay” i fe a gy ahs gg VO Sts gy Sts ty —s 
—Y 

In the product of these two OGFs, the number of terms 

of degree n would be the number of ways of making n¢ 

postage. For instance, the terms of degree 23 (i.e., the 

terms whose exponents have 23 as their sum) are 


gS y? and gee 


It follows that if z is substituted for x and y, then the 
coefficient of z?° is the number of ways. Thus, the OGF 
is 


1 OO Tr 
Sie = Dope” = Bh eee 
n= j= 
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That is, the only way to get n¢ postage is to find an a; = 1 
and a b,_; = 1. The sequence (p,,) is not monotonic. For 
instance, 


Pia = 1 pips =2 pip = 1 


COMPUTATIONAL NOTE: In trying to obtain actual val- 
ues for such a sequence, it is useful to have the aid of a 
computational engine such as Mathematica. 


DEF: The convolution of the sequences (u,,) and (v,,) 
is the sequence 


UNVO, UOV1 + U1LVO, UoVe + U1V1L + U2QUVO, 


Example 1.7.6, cont.: Thus, the sequence (p,,) is the 
convolution of the sequences (a,,) and (b,). 


Example 1.7.7: Four distinguishable six-sided dice are 
rolled, each marked with the numbers 1, 2, 3, 4, 5, 6. ‘Then 
the generating function for the number of ways that sum 
of the outcomes could be n is the coefficient of z” in the 
expansion of 


g@t274Ah4442 4 2) 


Proposition 1.7.3. The product of the generating func- 
tions 


Ug) = Sune" and V(z)= So uaz" 
n=0 


n=O 
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is the generating function 
OO mr 
U(ZV 2): = Se oa Ss COs 
n=0 g=0 


for the convolution of the sequences (u,,) and (v,). & 


Example 1.7.8: The rational functions 
1 1 
and 
L222 132 
generate the sequences (un = 2”) and (vp; = 3”), respec- 
tively. Their product is the generating function 








1 2 is 3 
(l1-—2z)(1-3z) 1-2z 1-32 
<2 ye Oar) 
n=0 


= 14+527+1927+ 6922 4.--- 


The convolution of the sequences (u,, = 2”) and (vy, = 3”) 
is the sequence whose n“* element (counting from the 0‘ 
element) is 


DP SOM dO gm edie aie eM a ae 
Thus, the convolution sequence begins 
1, Dy. 193. 69, 


in affirmation of Proposition 1.7.3. 
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Sums and Generating Functions 


Prop 1.7.3 has a slue of useful consequences. An im- 
mediate consequence is that it provides a method for going 
from a counting sequence to its sequence of partial sums. 


Theorem 1.7.4. Let B(z) be the OGF for a sequence 
(b,). Then the OGF for the sequence 


(so | n=Oh-) 
j=0 


of partial sums is 








B(z) 
l—z 
Proof: We observe that the total coefficient of z” in 
B 
3) = (bo toyz +bo27 +--+) (L4z4t274+--:) 


equals the sum y= b;, as per the following calculation: 
by + byz + bgz7 + b32° +++ 
ee es 
by + byz + byz7 + b32° +++ 
bog ize bee ia cess 
ba debi? Pibee* sb bar? eae 


by + (by + bo)z + (bz + by + by)27 +++: 
This is just a special case of Proposition 1.7.3. 
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1 —. —1 
Corollary 1.7.5. aaar os x “= ) zt 
Proof: By induction on r. 


BASIS: For r= 1, we have 


qo = SP = SCT )e 


since the value of each of the coefficients () is l. 
IND HYP: Next, suppose for some r > 1 that 
t ~ (" +r— : 3s 
_ r—l = > a 
(1 — z) fay ae 


IND STEP: ‘Then 
1 1 1 
(l—z)P 1-2 (1-2z)r7} 


_ Et Ne n (ind hyp) 














n=O 
=->r > roe meee -_ (Thm 1.7.4) 
n=0 7=0 
— Ga gi I yi jt+r- (factor j-sum) 
* es ee) = ep yt 


n=O 
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= eC o 


Table 1.7.1 OGEs for some sequences. 


sequence closed form 
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1 
Example 1.7.9: The rational function ———— gener- 
(l= @)e 
ates the sequence 
va St Oo. Be. ae 
1 
; i: 
Example 1.7.10: The rational function ———; gener- 
(1 — z)* 
ates the sequence 
2 
CF ) Se ee ey 
2 
1 “({ntr—-1 ee 
Corollary 1.7.6. aay = at oe Ja Zz 
Proof: Substitute az for z in Corollary 1.7.5. o; 


1 
Example 1.7.11: The rational function ————~ gen- 
(1 — 22)? 


erates the sequence 


1 
Cf ee 1, 4, 12, 32, 


1 
Example 1.7.12: The rational function ————~ gen- 
(1 — 2z)3 


erates the sequence 


2 
. je 1, 6, 24, 80, 
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1.8 SYNTHESIZING OGF’S 


Synthesizing an OGF for a given sequence is a skill, 
like analyzing them, that is fundamental to solving count- 
ing problems with them. ‘The approach is to recognize 
fundamental patterns in the sequence and to perceive how 
these patterns were combined. 


Example 1.8.1: In the sequence 


Ai De 5 91 2G De, Daas (1.8.1) 


is 1s, Be. “de, Be 16> oe (1.8.2) 


and 
2, 22% By. Dy. oes (18.3) 


It seems that sequence (1.8.2) acquired negative signs on 
its even elements, that the entries preceding the entry 4 
were truncated, and that it was then interwoven with se- 
quence (1.8.3) by strict alternation. 


Example 1.8.1 serves as a running example for this section. 
Our objective is to construct its generating function. 
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Substitution 


Prop 1.8.1 Substitution Rule. If G(z) is an OGF for 
the sequence (g,,), then G(bz) is an OGF for the sequence 


(b" gn). 





Proof: S— gn(bz)" = DE Ge & 
Example 1.8.1, cont.: By Example 1.7.9, the OGF for 
the sequence (1.8.2): 1, 2, 3, 4, ... is 
1 
(1 —z)? 


Substitute (—1)z for z, according to Proposition 1.8.1, to 
obtain the OGF 





ie SEDs B+ othe Bh i aes (1.8.4) 


Shifting Right and Left 


DEF: Shifting the sequence (a,,) to the right by k 
places yields the sequence 


k zeroes 


—__eo 
0, 0, wey 0, AQ, G1, AQ, «+. 
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The corresponding generating function is 


ea . 
z* A(z) = Ss ge 
j=0 


DEF: Nullifying the j** element of the sequence (a) 
means replacing a; by 0. The corresponding generating 
function is 


A(z) — at z) 
DEF: Shifting the sequence (a,,) to the left by k places 
yields the sequence 


Ak, Ak+1, Gk+2, ++ 


The corresponding generating function is 


k-1 ’ oo : 
ae AG) — ae aye! = os a;zI—* 


The terms do, a@1,..-, @%—1 are nullified, so that they do 
not end up as non-zero coefficients of negative powers of 
re 


Example 1.8.1, cont.: Shifting sequence (1.8.4) to the 
left by three places yields the sequence 


—4, 5, -6 7, -8, 9,--> (1.8.5) 
which corresponds to the OGF 


l —4— 32 
eS a ) 
: aa Meee (+2) 
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Spacing Out 


DEF: Spacing a sequence (a,,) by k units yields the 
sequence 


k 0's k 0's k 0's 
ee ee 
a0, 0, see , 9, 1, 0, see oO; a2, 0, see , 9, see 


The corresponding generating function is 
A ( nr) 
Example 1.8.1, cont.: Spacing sequence (1.8.5) by 1 


place yields the sequence 


= 0, 9, Q, =0, 0, «; Q, =, 0, eee 
(1.8.6) 


which corresponds to the OGF 
—4 — 3z —. =e 337 
(1 1 z) Zz? 7 (1 a z*)° 
Isolating a Subsequence 
DEF: Isolating the subsequence n = k mod m of 


the sequence (a,,) yields the sequence in which all terms 
are nullified, except those whose index is congruent to 
k mod m. 
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For modulus m = 2, the corresponding generating func- 
tion is 


A(z) + A(—z) tk =0 
2 

BOG? pd 
2 


Example 1.8.1, cont.: Since the rational function + 


generates a sequence of 1’s, the generating function for the 
sequence (1.8.3) is 
2 


l—z 





Isolating the 1 mod 2 subsequence from sequence (1.8.3) 
yields the sequence 


>. DO. GD. 44 (1387) 


which corresponds to the OGF 


1 2 2  2z 

Oise ae ez? 
which might also have been obtained by spacing sequence 
(1.8.3) out by 1 unit and shifting right 1 place. Sequence 


(1.8.1) is the sum of sequences (1.8.6) and (1.8.7). Thus, 
its OGF is the sum of their OGF’s, i.e., 








= — 22 22° + 3244423 4 22427-4 


(+2 '1-2 = @—A)\a+2) 
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Differentiation 


DEF: The derivative of the generating function 


GZ); = ae 
n=0 


is the generating function 
OO OO 
Ge) = Ndnz” > = eC +1) Gn41 2” 


Example 1.8.2: Consider the generating function 


CO 


Ce) = <5. = oe 


n=O 





Then taking its derivative yields the equation 


Ge) = coop = Si(n$1)j2rtten 


n=O 


which is consistent with Corollary 1.7.6. 
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1.9 ASYMPTOTIC ESTIMATES 


The growth rate of a function is customarily reckoned 
via comparison to benchmarks. The focus is on the long 
term. 


DEF: Let f(n) be a function such that f(n) 4 0 for suffi- 
ciently large n. The sequence z,, is asymptotic to f(n) 
if 


lim —Y = 
n-rco f(n) 


It is often reasonably straightforward to guess or to find a 
well-understood function f(n) such that the ratio 


Ln 


f(n) 





converges. 


Example 1.9.1: How large is the Catalan number c,,? 
From the expansion 


=. (") _ 1 (Qn)e 




















nt+1i\n n+l ni 
— 1 2n 2n-1 (n +1) 
 n+t1ln n-i1 1 


one sees that the Catalan number c, is a product of the 


value of aI and the values of n other factors, whose values 
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form an increasing sequence from 2 ton+1. One surmises 
that 
2? (1+1)” 


é — 1)yr-t 
io aac (n+ 1) 





which is a very wide range of possibilities, since the lower 
and upper bounds are far apart. Narrowing that gap is a 
primary need toward improved understanding of the be- 
havior of the Catalan sequence. 


Ratio Method 


Ratio Method: Some information about the asymptotic 
behavior of a sequence z,, lies in the ratio 


Ln 





Ln—-1 
of successive terms. We calculate the limit of that ratio. 


Example 1.9.1, cont.: The ratio of successive entries 
of the Catalan sequence is 


Cho 1 2n 1 (/2n-—2 
Go man n\n-l 


1 (2n)2 / 1 (2n—2)"=* 








n  (n-1)! 





n+1 ni 
1 Ca 
n+1 (Qn- 2a 
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1 = (2n)(2n — 1) 























n+l n 
— ee (1.9.1) 
Cray ee i 
. on . 4n —2 
= lim = lim 
NCO Cy —1 nooo m+ 1 
4. 4 6 
= lm a — lim = 4— 
3 Cy 
=> lim = 4 (1.9.2) 





MF CO Cn—-1 


"_ is everywhere less than its asymptotic 





Since the ratio = a 
upper limit of 4, and since cj = 1 < 4, it is possible to 


narrow the estimating range of c,, to 


Qn 1 (2 
< t, = ee < 4” (1.9.3) 


n+l m+1\n 
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Tightening Bounds on Estimates 


Concrete Substitution: Concrete early values of a se- 
quence can often be used to improve asymptotic upper 
and lower bounds. 


Example 1.9.1, cont.: Sharpening the lower bound of 
(1.9.3) for the Catalan number c,,, including eliminating 
the denominator of n+ 1, can begin with an observation 
regarding the ratio —= : after n = 5. 





Ania DS BA forn>5 
4n—2 Sate? _ 3 
nm+1l7 n+l 


Recalling (1.9.1), we have 








Cn 








> 3 (1.9.4) 
Cn—1 
Using (1.9.4) and the fact that 
Cy, CG Cy 
Ci. Ta Ch a oe 8 
C4 C5 = 1 


we infer that 
Ce > eye 3 => T4938"? 
14 1 


= i = a 2 ad forn>4 (1.9.5) 


The inequality (1.9.5) also holds for co, c1, cz, and cs. 


Cn 


=> 
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Recalling the inequality (1.9.3), it follows that 


1 
; riot ee eg, ee A" forn > 0 (9G) 


We shall now show that the coefficient of + can be 
removed from the lower bound of (1.9.6) for sufficiently 
large values of n. Since the ratio 


Cn 





Cn—1 
is increasing monotonically to 4, it eventually exceeds t 
say, for all n > P. Since £ > 1, there is a number @ such 


that 


Combining (1.9.6) and (1.9.7) yields the desired result 


2 Cy ee Ae forn>Q (29:8) 





ro 3P 
(5) ee for allg>Q-P 
2 Cp 
which implies that 
ep (SEH Ea a £2), (Sats S02 en ) 
CP P+ cQ-1 CQ. eQtil Cn—1 
. 7 Q-—P 74 n—-Q 
P°\5 5 
3P ; 3Q—P : gn—Q 
co > 3 (1.9.7) 
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Remark: In fact, this lower bound is further improvable. 


Since the ratio 
Cn 





Cn—1 
is increasing monotonically to 4, it eventually surpasses 
4—e for any € > 0, say, for alln > N(e). It follows, by an 
argument similar to that used in the derivation of (1.9.6), 
that 
CN(e) 
AN(€) 





(4—€)" <a, < 4”  forn> N{e) 


The coefficient could be removed, once again, as in the 
derivation of (1.9.8), to yield the asymptotic estimate 


(4—€)" < ce, < 4” 
which is adequate for present purposes. 


The following proposition formulates the method used 
in Example 1.9.1 as a general principle. 


Proposition 1.9.1. Let x, be a sequence such that 


= Ko 0 





; XL 
ltMn— 00 
Ln—1 


Then, for € > 0 and sufficiently large values of n, 


(ko —e€)”" <e, < (K+e)” (1.9.9) 





If the ratio =**— is bounded above by K, then (1.9.9) can 


Bie 


be sharpened to 
(ik —€)" <en < aok” (1.9.10) 
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If bounded below by K, then (1.9.9) can be sharpened to 
tok” <n < (K+e)” (lOstT) 


Proof: Details from Example 1.9.1 are readily trans- 
formed into a proof. This is left to the Exercises. o; 


Asymptotic Dominance 


DEF: If there is a positive number c such that 
f(n) < eg(n) foraln>N 
then we may write 


f(n) € O(g(n)) 


and say “f(n) is in big-oh of g(n)”. The numbers c and 
N are called witnesses to the relationship. 


TERMINOLOGY NOTE: Although O(g(n)) is defined here as 
the class of functions that are eventually dominated by a 
multiple of g(n), the usage “f is big-oh of g” (omitting the 
preposition “in”) is quite common. The rationale is that 
membership in the class may be regarded as an adjectival 


property. 
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Example 1.9.2: One way to prove that 7n? € O(n?) is 
to choose the witnesses VN = 7 and c= 1. Then 


Tn? < 1-n® forn>7 
Another proof uses the witnesses N = 1 and c= 7. Then 


Tn? < 7-n°? forn>1 


In general, there tends to be a tradeoff in the size of the 
witnesses NV and c. Choosing a larger value of witness c 
may enable one to choose a smaller value of witness n. 


Example 1.9.3: To prove that n° ¢ O(7n7), we observe 
that for any witness c, and for any number n > 8c, 


n° > (8c)n? > Te-n? 


